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A theoretical onodel and a ca-s-e stud^ are described to 
support thti precise that the ideolcgical levels of neibers of a 
social change project must be identified in order to assess their 
potential for inaucing change and to evaluate that change. A 
conceptual model of the development of a social justice ideology is 
fcrtiulated, and is descrited as teing most peLrtinent to change 
projects. Ihe change agents' ideology is classified in one of three 
developmenral stages. By understanding a member's concept of social 
justic, tne potential extent cf change is gauged. I hree parallel 
cnaracterrstics of change groups are identified: the ideolcgical 
basis ot change; the intended outcomes in terms of social chaiige; and 
tne change technigues. Data used in developing the ideological model 
are based on a project evaluation, funded by the iomen's Jducational 
Equity Act (KEEA) to increase the number of female xui>lic school 
aaainistra tors within a 'particular state. It is suggestea that 
evaluation should encompass net only the goals and cutccases of a 
project, but also the ultimate goals, the jus tificaticn for those 
goals, and the manner in which the goals are attained. Also, it is 
advocated that evaluation methods include an assessaent of 
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EVALUATION OF IDEOLOGY: 

A CASE STUDY OF SOCIAL GHA.NGE 

Planned social change projects are funded by their benefactors to conduct 
activities which will effect significant change. To determine the extent 
and effectiveness of a project's efforts, an evaluation is typically accom- 
plished. In the evaluation of a project to increase the niffbor of women in 
educational administration funded by the Women's Educational Equity Act 
(WEEA), the authors of this paper have found ideology to be a critical 
determinant of a change effort's ultimate effectiveness. Our basic premise 
is that only through identification of the ideological level of a social change 
project's members can their potential for inducing change be determined and 
an evaluation accon5)li5hed. 

In this paper, a planned social change project is defined as any pre- 
meditated effort to alter the existent values and behaviors of individuals 
or groups of individuals. Social change occurs and is significant when, as 
defined by John Stuart MiTl (1871: 94-95), "One custom or institution. , . 
from being a supposed primary necessity of social existence has passed 
into the rank of an nnivers^Uy stigmatized injustice and tyranny. This 
passage is complete when the customs, values and laws of the society and 
the behavior of the people reflect the belief that the previous customs or 
institutions were unjust. 

Because planned change projects are treatments or interventions in 
the social system and not simple experimental treatments of individuals, 
we follow Riecken's and Boruch*s (1974: 364) tripartite distinction of goals 
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to be considered in an evaluation* According to Riecken and Boruch, project 
goals can be classified as "perfonaance," 'Hnsi rumental and ^•ultimate," 
At the performance stage, daily activities are accomplished to impleiBent the 
instrumental goal. These instrumental goals provide, in turn, the "principal 
means" to accomplish the ultimate goals. 

Often in the evaluation of change projects only the performance goals 
axe considered and success is detennined on the basis of how well the project 
members accomplish their daily tasks and objectives. For example, an evalu- 
ation limited to consideration of successful accomplishment of a project 
objective, such as the publication of a quarterly newsletter, does not examine 
the worth of the objective itself— publishing a newsletter. Competent evalu- 
ations must consider, therefore, not only the performance goal, publishing 
the newsletter, but also the instrumental goal, the worth of the newsletter. 
Finally, fnran evaluation to provide a complete accounting of a project's 
social change efforts, the ultimate goals of the project must be evaluated. 
In this newsletter example, the evaluation of the ultimate goal would consider 
how well the newsletter assisted the project in effecting change. 

Although evaluation of the three goal stages is necessary, consideration 
of the ultimate goal provides the method to determine the full extent of 
social change effected by a project. In this paper we will offer why consider- 
ation of the ideological development of a planned social change project and 
its members provides the best indication of the potential or past effective- 
ness of a project to induce social change. Even though the context of our 
work has been an educational change project, the following theoretical devApment 
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is gen«raliiAbl« beyond education issues and beyond scxisn. issues. Through 

an explanation of our theoretical framework we offer our concepts of ideological 

development, provide an example of our data analysis and discuss the in^lica- 
tions. By understanding under what conditions change can be anticipated, not 
only can an effective evaluation be accomplished, but individuals who wish to 
effect social change slfould better be able to develop effective strategies. 

Theoretical and Conceptual Background 
To determine the best methods to evaluate a project's goals and the 
strategies it employs we must understand first how social change can occur. 
Although there car be no certain procedures to discover the requisites of 
change and how to evaluate them, we have chosen a methodology which lies 
between dogmatic empiricism and theoretical abstraction. Heeding the advice 
of Donald T. Cainpbell (1975: 17), who reminds us that "in ordinary science, the 
one who designs the experiment also reads the meter/' we do not limit our 
investigation to the hypothesis^ test method. Because the scientist must 
select the methods and procedures to be used in an experiment, eirpirical 
verification must exclude what are assumed to be extraneous variables. Thomas 
Kuhn (1970: S9) comm.ents on this subjective procedure by explaining that the 
choice of a "particular piece of apparatus and to use it in a particular way 
carries an assumption that only certain sorts of circumstances will arise.*' 
He likens this method to "puzzle solving" or "»chi«ving the anticipated in 
a new way (p. 36)." Wien "members of a given coiwmity" operate within the 
strictures of a particular mind-set, Kuhn terns their "entire constellation 
of beliefs, values and techniques" a "paradigm (p, 175)." 



A major methodological issue is* therefore* the need for researchers and 
experimenters to move beyond the parochialism of a specific paradigm and 

generate new concepts and new theories. Had Columbus not disregarded the 
scientific evidence ot a flat worlds he would not have sought funding for 
his experiment* Likewise^ we must understand that we presently cling to 
paradigms that will seem as humorous to our descendents as our ancestors^ 
paradigms now seem to us. 

How then can we ever expect to move beyond our present paradigms to 
generate new concepts and theory t Because dogmatic adherence to the hypothesis- 
test-pronounce method keeps evaluators within the confines of anticipated 
soli:tions, we must devise methods that allow us to look outside of our para- 
digms- Whatever the methods may be to help us escape the narrowness of our 
paradigms, any single method cannot completely define reality. Norman Dentin 
maintains (1570: 26)^ and we agree, that ^^multiple methods" must be used 
'*because each method reveals different aspects of ^pirical reality.^' In 
this approach to defining reality, Denzin echoes the sentiments of Webb^ et 
al (1966: 174) who state^ **T1iere mwst be multiple operationalisrt* • *this 
means ^ obvious ly^ that the notion of a single ^critical experiment' is 
erroneous J* This concept of multiple methods or operational ism^ also known 
as ''tri angulation** (Campbell and Fiske, 1959), has been expanded by Dentin 
(1970: 301) to include 'Varieties of data, investigators^ and theories*^ in 
addition to methods^ For our inquiry into the process of social change and 
its evaluation to be worthwhile we must employ^ therefore^ a variety of 
methods, data, theories and investigators. 



Building Theory 

To see beyond the confines of our paradigms we must generate new con- 
cepts and use different methods to lead u« to unanticipated findings. Building 
new theories is, therefore, an important issue in our inquiry into discovering 
the essential components of planned social change evaluations. Because mjch 
investigation concludes erroneously with the proclamation of new theory, we 
will initiate our inquiry by offering a definition of theory, as tht tenr. is 
coomonly used in social science research » 

With the current quantitative devotion by most researchers and evaluators 
in education and psychology, we have necessarily turned to other disciplines 
for a definition of theory and an explanation of how to build theory. Socio- 
logist Norman Dentin (1966:6), for example, explains, "Rather than applying 
just a set of methodological principles to research strategies— which leads 
to an even greater gap between theory and method--i. combine a theoretical 
perspective with a series of methodological rules." For Dentin (p. 5), theory 
is defined as an "integrated body of propositions the derivation of which 
leads to explanation of some social phenomena." Similarly, Robert Mertoi< 
(1968:143) explains that "sociological theory refers to logically interconnected 
sets of propositirns from which wapirical uniformities can be derived." 

Because we cannot yet derive "unifoimities" from our inquiry, we con- 
sider our research to be, what Dentin calls theory-work." He explains (1966:66): 

What often passes for theory in sociology, however, is not 
theory* Instead there are various types of theory-work 
ranging from ad-hoc classiflcatory systems to categorical 
systems, taxonomies, and vaguely interrelated conc^tual 
schenes . 

7 
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Sociologists, ho^ty^x^ *re cettaltily not the only ones to hlmk for the develop- 
laent of unsubstantiated theory* 

Our inquiry into understanding how best to evaluate the extent of change 
induced by a project is, therefore, theory-work which falls within the category 
of a conceptual framework. For Dentin (1966:67) a conceptual framework is 
developed when ^descriptive categories are placed within a broad structure 
of both explicit and assumed propositions, . ^Tht framet/ork Is yet too imprecise 
to permit the systematic derivation of propositions , but deductions are possible*'^ 
On the basis of our experience with one social change project within the 
context of one fxmding effort (WEBA), we can hardly offer a coiiqpleted theory • 
We do, however> offer a framework from which social change efforts can be 
evaluated and further research accomplished to develop coB^leted theory. 

The theory-work in this paper provides a conceptual framework for the 
evaluation of change projects which combines both qualitative and quantitative 
data* Although many researchers consider both types of data to be incompatible, 
Claser and Strauss (1973:17) coKsent upon this ^'fundamental clash,** by 
explaining, "What clash there is concerns the primacy of emphasis on verifi- 
cation or generation of theory.^' Whereas hypothesis testing and verification 
.provide pronouncements of results, Glaser and Strauss (p* 40) suggest that 
when theory generation is the goal we must be *^alert to emergent perspectives^* 
that will help us develop our theory. 

The generation of theory is made possible by what C. Wright Mills (1959: 
211-212) calls '^sociological imagination.^' This ability to ♦♦shift fro« one 
perspective to another*' enables us to '-build an adequate view of a total 
society and its cooponents (p^ 211).'' By limiting their vision to the hypothesis- 



test-pronounce method, researchers and evaluators are excluding the ayriad 
of alternative explanations that may be responsible for an effect. Through 
the generation of concepts and theory based on both qualitative and quanti- 
tative data, we can provide a better definition of reality to detetmine how 
best to evaluate a social change project. 

A number of theoretical concepts have guided our understanding of thi- 
evaluation criteria necessary to determine the effect of ideology on social 
change projects. We first explore the concept of social justice, especially 
as formulated by John Rawls. Then, building on insights of theorists such as 
Jean Piaget, we suggest that individuals' cognitive processes and conceptions 
of justice may be understood by examining their behavior as well as their 
rationale for this behavior, From the work of Lawrence Kohlberg we also 
explore the influence of justice and morality on ideology. Finally, we 
cite evidence that individuals' ideology is related to their concepts of 
social justice which affects the extent of social change to be produced. 

Social Justice 

The entire history of social iii5)rovemant has been a series of 
transitions, by which one custom or institution after another, 
from being a st^posed primary necessity of social existence, 
has passed into the rank of an universally stigwitljed injus- 
tice and tyranny* So it has be«n with the distinctions of, , , 
nobles and serfs, patricians ai*d plebiansj and so it will be, 
and in part alicady is, with the aristocracies of colour, 

race, and sex. ^ 

—John Stuart Mill 0871; $4-9S) 

Only a limited amount of goods and services are ever available in a 

society and methods must be devised, therefore, to allocate these scarce 
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resources. Since the methods of distribution depend upon the values and noral 
code of those who hav« the power of distribution, the concept of social jus- 
tice aj.*ises when the fairness of allocation is considered. When the methods 
of distribution are not universally seen as socially just, the ^'transition" 
from one "custon or institution" to another, to which Mill has referred, can 
begin . 

In the evaluation of planned social change projects, which are presumably 
undertaken to create more equitable situations, the consideration of social 
justice is essential. To determine if a project can be effective or has been 
effective, the project must be evaluated upon its ability to assist in the 
process of "social improvement," as explained by Mill. 

Because social justice is defined by the beliefs and values individuals 
hold, any conception of justice can be developed hjid considered rational for 
the individuals who share the same beliefs and values. This shared assump- 
tion or belief in justice is similar to Kuhn^s concept of the paradigm in 
science. In both instances individuals operate within the strictures of a 
particular mind-set which, as Kuhn explains (1970:57), can "insulate" a 
cooBBunity from "socially important probl«»$," For example, in the creation 
of the American republic, the founders agreed that in their social change 
project all "nen" were created equal. Unfortunately, the rationale for 
this justice was based \xpon the belief which meant only "men," and excluded 
women, slaves and other non-aristocratic outsiders from any consideration 
of this equality. In a siMlar »aaner, a narrowly defined social belief has 
United a wo«an*s opportunity to become an administrator in education. The 
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logic for the maintenance of the inequitable situation has been based upon 
the belief that educational administration is not a woman's role* Obviously, 
any conception of justice can be developed and considered rationale for 
individuals who share the sajne ideology. 

Although we believe no universal concept of justice has yet been devised, 
effective evaluations must still Judge a project's members upon their con- 
cepts of social justice* Even though justice is defined by beliefs and 
values of the dominant culture of a society^ John Rawls (1971) offers two 
basic principles of justice which can be used as judgmental criteria in the 
evaluation of a project's concern over social justice. According to the 
theory, when individuals who are unaware of or ^Veiled^^ to their own position 
in society and knowledge of their fortunes, abilities, and intelligence 
assemble in an hypothetical "original position,*^ they would choose Rawls 's 
principles of justice (p. 12)^ This original position is defined as the 
'^appropriate initial status quo^ and thus the fundamental agreements reached 
in it are fair (p. 13).*^ *n>e first principle states^ basically, that every 
individual has an equal right to all basic liberties within the system of 
libei cy for all* The second principle e)q)lains that social and economic 
inequalities are allowable only if such inequalities benefit the ^4east 
advantaged (p. 302-303) J' 

Rawls *s principles of justice can be helpful criteria for evaluating a 
social change project , but we must remwaber that these principles are based 
xxpon certain assuB^tions made by Rawls* In the original position, for 
exaiBple* Rawls assumes that the choice of justice principles occurs behind 
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a *Wci\ of ignorance," where no one "is advantaged or disadvantaged in the 
choice of principles by the outcome of natural chance or the contingency of 

social circumstances (p. 12) J' A further assumption of Rawls's is that 
individuals in the original position are "rational and mutually disinterested 
(p, 13)," This condition of a "well-ordered society, effectively regulated 
by a public conception of justice," establishes the basic assuaptions under 
which the original position operates (p. 4-5), Even though Rawls«s use of 
this abstract original position is an "expository device" to "envision our 
objectives from afar (p, 21-22)," we still have no assurance that parti- 
cipants in the original (position who subscribe to different values or hold 
different political ideologies would always choose Rawls's principles of 
justice. 

No matter how Rawls tries to have us believe the parties in the original 
positions are veiled to theit place in society, their decisions of justice 
must be based upon their concepts of fairness and morality in their own 
society. Wliatever the veil, individuals must bring their beliefs and values 
to the original position or they would be aiaoral beings, incapable of pro- 
viding judgments of social Justice. The parties to Rawls's original position 
can only provide justice as they perceive it from their own social customs 
and morals, whatever their fortunes or intelligence* 

Rawls's theory is valuable for us, however, not only because of its 
worthy principles of justice, but fro* an wialyais of the theory we can estab- 
lish the criteria for judging the social justice concepts of a change 
project's manbers. Although Rawls's theory is as dependent upon assumptions 
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of so'ilal customs and morals as any other concept of Justice, the theory does 
provide f. basis to evaluate a change project member?:' conception of justice. 
By considering hov a project deals overall with the "least advantaged" 
members of the society, for example, we can gauge the ultimate social effects 
of the project activities. 

Our use of Rawls's theory must be limited, however, because although the 
theory pro^des a just method for the equitable distribution of resources, 
there appears no certainty in the theory that the propriety of use or produc- 
tion of resources will be questioned. Additionally, we are unsure that uni- 
versally considered rational principles will emerge from the original position. 
As an example, Rawls's theory can tell us how the parties to the original 
position would equitably distribute Winnebago motor homes* but the theory 
does not tell us if the social value of having or producing Winnebago s will 
be considered. Even though Rawls includes the assumptions of the "veil of 
ignorance" and the consideration of a Just amount of savings for future 
generations (p. 285) ^ the rationale employed by the individuals in the original 
position depends upon the social beliefs they share. Even if all parties 
believe Winnebago s are a social necessity and that this commodity should be 
distributed on the basis of wealth (the current practice in our society), those 
with a different social perspective will still see this method of justice 
as irrational. In a critique of Rawls's theory, Robert Wolff (1977: 195) 
addresses this issue by explaining that the theory is "ideology, which is to 
say a prescription masquerading as a value-neutral analysis." Wolff further 
characterizes the theory "brusquely, as a philosophical apologia for an 
egalitarian brand of liberal welfare-state capitalism {p. 195)." 
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Although Uawls' 5 theory is dependent upon assua^tions which limit the 
applicability and universality of the theory, the principles of jiir»tice can 
serve as guidelines in the determination of the extent of change a social proj 
aaii induce or has induced* Members of a social project need not subscribe 
to Rawls^s principles of justice to be effective^ but the manner in which 
the concepts of the ^^least advantas^d^' and ^'liberty'* are considered can 
indicate how aware individuals are of their own biases • The developmental 
level of a social change project can be determined by the manner in vhich 
the members understand their values and consider the concept of social 
justice. Because there are, as yet, no universally accepted principles^ 
individuals must become aware of their values and their beliefs and then 
attempt to derive principles of justice as logically as Rawls has done* 
By including a judgment of the manner in which a planned social change 
project and its members deal with the concept of justice in the methods they 
eii5>loy to effect change^ we can determine if '^social improvement'' (using 
Mill^s term) which abolishes unjust aristocracies is being accomplished. 

The Conceptual Framework of Id^lpgy 
Our Stage Development of the Framework 

To develop a conceptual framework for the evaluation of planned social 
change projects we have sought theories and methods that would encompass 
judgments of the three goal stages of a project— ^performance > instrumental 
and ultimate* In formulating our framework we recognize that many evaluation 



methodologies provide effective evaluations of performance and instrumental 
.joals but do not adequately judge the ultimate goals of a project and indi- 
cate the extent of social change effected. Although the work by Stufflebeam, 
et al (1971), for example, focuses upon performance and instrumental goals 
for decision-making, this methodology docs not suf ficiently consider the 
ultimate social goals. As another example. Ernest House's work (1976), Vfhich 
considers Rawls^s theory of justice to provide "a standard by which evaluations 
can be judged for their justice (p. 99)" does not comprehensively explain if 
the ultimate goals of a change project would be evaluated. To use- Rawls's 
theory as a standard means acceptance of similar social assumptions, which 
have been characterized by Wolff as liberal -capitalist " apologia ." In a 
similar manner, responsive (Stake, 1967) and value-free (Scrivcn, 1975) evalu- 
ation methodologies do not provide methods to judge the ultimate effects of 
social change projects. 

In conceptualizing a framework that could judge the ultimate goals of a 
social change project we have begun with Piaget's (1953: xviii) concern over 
the "operational mechanisms'* of cognitions rather than only the outcome of 
these cognitions. By placing the en^Jhasis in our theory-work on the cognitive 
process, as Piaget has done, we have attempted to understand the values and 
interactions which influence the ultimate goals. Judgments of outcomes can 
provide only a partial description of reality when we understand that the 
ramifications of change projects should continue to be apparent in the future* 

To create extensive, long-term change, projects should leave some con- 
tinuing legacy of their efforts^ An exaa^le of this legacy is when an 
educational change project (the one upon which our data is based) recruits 



wom^ to a doctoral progTam in edxicational administratioTi* Because the 
women may need several years to complete their degrees and several more 
years to gain the necessary e^qperience to become an administrator, the effects 
of the project efforts may not be apparent for six or seven years. Addi- 
tionally, assuming the project caused the recruitment of women to the doctoral 
pxDgram to become a priority activity for the institution, women who enter 
the program in the fxiture will benefit from the legacy of change created by 
the project* The evaluation of a project only on the basis of its present 
outcomes would provide only a partial indication of change the project may 
induce. Because social change projects should leave u. legacy of change 
after their funding has ended^ it is essential that we estimate this legacy 
and its process of development in the evaluation of the full extent of a 
project's effect. 

C^ly when we evaluate both the processes and outcomes of a change project 
can we completely determine the ultimate effect of a project* Evaluation of 
performance and instriimental goals can indicate only if a project completed its 
objectives. Through consideration of the ideology of a project ^s m^ibers, 
however, we can judge the social effect a project has made and will continue 
to make in the future^ 

Because we can never be certain of individuals* cognitive process and 
ideology from their response to a questionnaire or interview^ for example, 
we have used multiple observations to indicate a change project m^bers^ 
ideology. Through the tri angulation of indicators such as the manner in 
which the work was conducted, the rationale for policies and strategies, and 
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the behavioral outcomes of the project, we have been able to provide an 

analysis of the project nembers' values. 

Whereas Kohl berg, whose ideas we shall next examine, uses a^pencil and 

papea"test of individuals' purported behavior to identify their level of 

cognitive moral development, we have used Individuals' behavior in concrete 

situations to indicate their cognitions. We follow these procedures because 

we have limited confidence in data that were derived from an interview 

which predicts behavior from an abstract situation. Through observation of 

how members of a federally- funded social change project developed and instituted 
their change strategies we have been able to classify their cognitive 

processes on the basis of their concrete behavior in the actual social 
change situation. 



The Nature of Ideology 

We have relied on the work of a number of theorists to understand how 
people* s beliefs change as a result of environmental and interpersonal 
interaction, and how beliefs influence attitudes and behavior. While a 
full investigation of the beliefs of a project staff are clearly beyond 
the scope of any evaluator, certain values, particularly those that per- 
tain to the stated goals of a project, are pertinent to an evaluation of 
the project. 

Beliefs are intrinsic in human action and are essential in the inter- 
pretation of behavior. While beliefs have traditionalJLy been overlooked in 
educational research, they reflect the values and cognitive understanding 



from which people act and are, therefore, critical for an analysis of 
social change projects ♦ 

Daryl BeiA defines beliefs as one^s cognitive representation of the 
vorld. He describes beliefs as dependent upon ^^one*s own sensory 
experience or upon a basic belief in the credibility of soBie external authority 
(Bern, 1970:5) .^^Beliefs also represent one^s accumulated personal experiences 
and one*s inherited cultural knowledge (Berger and LuckBmn, 1967). 

We have chosen the term •■ideology** to designate ^'an interlocking set 
of beliefs (Bo>^eTS, 1977: 3S)*' used to justify cultural inaintenance or change* 
Ideology, as all beliefs, develops out of the personal experiences of individuals 
According to Mannheim, "llie ideological element in human thought. * *is always 
bound up with the existing life-situation of the thinker (Mannheim, 1936: 80)/^* 
Ideology is also the set of beliefs used to justify collective political 
behavior: ^'It is the direction of this will to change or to maintain, of 
the collective activity, which produces the guiding thread for the mergence 
of their problems, their concepts and their focus of thought OJannheim, 1936: 
4}.^' Ideology is comparable to Bem^s notion of ^^first order beliefs based 
upon an unquestioned lero-^order faith in some internal or external source of 
knowledge (Bern, 1970; 6-7)^^' In our framework, we will refer to both individiial 
ideology and group ideology. Although the differences of individual ideology 
is never fully reflected in group decisions, we categorize group ideology on 
the basis of the consensual decisions* 



Morml Beliefs as Ideology. In this conceptual fraaiework^ we are con- 
cerned about certain moral values, particularly the concept of justice as 
equity- We assume that the moralism of justice as equit-y is an ideology 
when it is used to justify social change. Because the change project we 
have analyzed atteiapted to achieve a more equitable situation for women in 
educational administration, we view the project manbers* beliefs regarding 
change as their ideology. 

Kohlberg has done extensive theoretical work in the area of laoral 

development. Drawing on the work of Piaget^ Dewey , Mead, Rawls, and others, 

he has developed a theory which accounts for tKe development of moral 

reasonings The concept of morality is central to this developmental 

schema: ^'morality is a natural product of a universal human tendency 

toward empathy or role taking, toward putting oneself in the shoes of other 

conscious beings- It is also a produce of a universal human concern for 

justice (Kohlberg, 1976: 67$)/^* Human morality, then, is one^s accumulated 

advancement toward an ideal form of justice. Kohlberg envisions advancement 

as extending from slji^le reciprocity to socially defined forms of justice, 

and finally, to the creation of a more just society. 

Kohlberg^ s work has given us theoretical guidance and support for our evaluation 
framework. He explains that one's moral reasoning changes as a result of 
interpersonal and environaental interaction, and the social context in which 
one interacts. We assume that the dynamics of development that apply to 
moral reasoning can be applied to more specific ideological change; in our 
framework, one*s conception of justice is coioparable to moral reasoning. 
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Kohlberg^s theory provides an understanding of ho^ moral reasoning 
changes through a developmental process. Underlying Kohlberg^s develop- 
inental model he envisions a dialectical process of "differentiation" and 
"integration" (Kohlberg, 1969: 390)* When people experience an incongruous 
situation (differentiation), they adjust cognitively to reach a state of 
equalibriiim (integration). This inherent process facilitates moral reasoning 
development as people experience beliefs or situations that are new. 

Conditions for Moral Reasoning > Kohlberg describes moral development 
as a logical progression in reasoning that develops from two sources; role- 
taking opportunities and moral atmosphere ^ Role taking is a form of social 

interaction where the self is able to understand the reality of another in a 

1 

behavioral and verbal exchange. 

Tht nature and frequency of role-taking opportunities influence the 
extent of moral reasoning (Kohlberg, 1969: 402)* It is in this empathic 
mode that people are able to understand conflicting points of view and gener- 
alize their judgments according to a broader social knowledge. Although one's 
understanding from such role^taking opportunities c^ be used for a variety 
of purposes^ we assume that the change groups to which we refer have made a 
prior commitment to social justice* 

We assume that members of a change project are more apt to change 
their moral beliefs or ideology if they are in a position to interact and assume 
the roles of others. For participants in a social change project, these role- 
taking opportunities come both within and outside of their project activities. 
As project members interact socially and philosophically they affect each 
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other's perceptions; likewise, when they interact with their 
target audiences they experience support or defiance for their beliefs. 

In either situation, they experience the role and attitudes they are atteaptin 
to change. 

Some poignant examples of this process occuired during the anti-war 
and civil lights movements* An oft <\uoted incident in the Student Non.- 
Violent Coordinating Committee CSNCC) typifies experiences that led women 
to form their own campaign for rights. In response to a paper regarding 
womenVs inequitable treatment which was presented to that organization, 
Stokely Carmichael cocmented, ^'The only position for women in SNCC is prone." 
A similar presentation by women inthe Students for a Democratic Society 
(SOS) elicited "storms of ridicule and verbal abuse." At a later SDS 
convention when women asked for a policy commitment to women's rights, 
they were thrown out of the convention (Hole § Levine4971: 403-405) . In 
these cases, women's understanding of their sexual stejreotyping and harass- 
ment came once they experienced the role of protagonist for their rights, 
A similar situation occurs for social change efforts. In the inter- 
actions whidi are a part of a change effort, participants are in a position 
to assume other roles and develop an understanding or empathy for those in 
inequitable situations. One possible outcome from this role taking is that 
project participants would change their level of moral reasoning to match 
the inequities they experience. 

These exajnples indicate priority of values individuals hold and illus- 
trate how inconsistencies in values can occur (SchtAan, 1973: 347-354), While 
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individual aight invoke principled rationales for certain changes, such reasoning 
may not be consistent with other inequities. The concept of priority of values 
implies that people's awareness and willingness to change rests on their 
experiences and other social and economic factors in their lives. The males 
involved in SDS and SNCC invoked their principles of social justice, 
although they were not willing or able to see their own repressive relationship 
with women, lli^ir morality was situational and limited. Likewise, for 
funded change groups, while participants will invoke justifiable principles 
to denounce the inequitable situations they are trying to change, their 

reasoning can also be liraited. For those involved in social change 
projects, it is essential to see beyond these situational values. 

While role-taking opportunities do not guarantee that project partici- 
pants will change or alter their moral reasoning, it is a necessary condition 
for such change. The essential point is that iBoral reasoning changes are 
facilitated when one has the opportunity to experience the inequities of 
others . 

A second factor contributing to moral develpment is the moral ataosphere 
in which people live and work. Thfi concept of moral atmosphere included such 
variables as institutional setting, funding source, and values and background 
of participants. For example, in federally- funded projects, the guidelines 
established and the measures of accountability demanded of such projects 
impede their potential for change. 

These two factors, tple taking and moral atmosphere, are merged by 
Kohlbcrg to form a general factor of social participation: this Includes 
both the extent and the nature of social learning and interaction* 



Ideology and Action. While Kohlberg provides an understanding of the 
intrapersonal aevelopttent of morality and limits his theory to the reasoning 
and cognitive level, we argue that beliefs do influence actions. There is 
evidence from analyses of social mevainents and social change agents that / 

/ 

beliefs influence behavior. Clifford Geertz portrays ideology as a synbolic 
structure which guides a society, "It is when neither a society*s most general 
cultural orientations nor its most down-to-earth, 'prajpaatic' ones suffice 
any longer to provide an adequate image of political process that ideologies 
begin to become crucial as sources of sociopolitical neanings and attitudes 
(Geert:;, 1973: 219)." Likewise, Ralph Turner observes, "the values held by 
the movement constituency affect selection of strategy both directly and 
indirectly (Turner, 1970: ISl)." 

In a study of change agents, Noel Tichy found that the congruence of 
values, cognitions and actions was highest for change agents who 
attempted the most dramatic social change (Tichy, 1974j 164-182). 
This group, which is labeled "Outside Pressure," showe^ the 
following Congruent behavior: a high degree of 
societal criticism, a primary goal of "equalization of power,*' and uncon- 
ventional tactics, such as mass demonstrations, confrontations, change in 
power structure, and civil disobedience. The other types of change agents, 
which were labeled "People Change," "Organizational Development," and "Analysis 
of the Top,'* share the following characteristics; a moderate to low degree 
of societal criticism, a primary goal of system efficiency and improvement 
of system problem solving, and conventional tactics such as training. 



stmctural chtngcs, lolt clarification, and technological innovations. The 
last three groups tended to be less congruent in their beliefs, cognitions 

and actions, and tended to stay within Lhe parameter of the status quo in 
both their change attitudes and actions, 

Tichy's survey demonstrates a correlation between beliefs and actions. 
Furthermore, the at.thor suggests that the congruence of values and attitudes 
or cognitions Influence the extent and nature of social action attempted, 
This is an important assumption in our framework of ideological development 
for change projects. 

A Proposed Model 

From our study of Rawls along with Kohlberg and Piaget, we have forrou- 
iated a conceptual framework of ideological development. Kohlberg provides 
us with our basic assumptions of the intrapersonal dynamics of change in 
beliefs which include the interaction of environmental and interpersonal 
factcjTs. Assuming the same dynamics, we focus on social justice as the 
particular ideology that is most pertinent for the investigation of change 
projects. 

The concepts of Justice held by a social change project's aenbers 
enable us to classify their ideology within one of three devclopBental 
stages. By understanding how a change project's members consider the 
questions of social change and the inequities of the society, we can gauge 
the extent of change to be expected from the project. Although we are 
unable to determine the ultimate justice of a project, we can predict 
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under which levels of ideological development the most extensive social 
change will occur. 

F oundations of the Model 

In our discussion, we will integrate three parallel characteristics 
of change groups: ideological basis of change, intended outcome in terms 

/ 

of social justice, and change techniques. y 

I 

Ideolofiical Basis of Change. We interpret the ideological basis of 
change by its variance ftom assumed values and mores ^ This variance rf^quires 
a capacity to be socially critical, >^hat Paulo Freire has called ^^conscientizacao 
(Freire. 1968: 19), and what G.A. Bowers refers to as "cultural literacy'' 
(Bowers, 1974), The capacity to be culturally critical is essential in a 
project* s attempt to alter social practices and belief s. The degree to %ihich 
these capacities are present in a group will influence the nature of change* 
Unless a project can envision social change at the deepest "principle" level, 
the danger of superficial and ten^orary modification of cultural practices 
is likely (Barnett, 1942: 14-30). 

We envision a continuum for this characteristic which would extaF.d 
from an acceptance of cultural values to a critical awareness of those 
values. This critical awareness is not a rejection of values but provides 
an understanding of the social ioplications of these values « For our 
framework^ we assume that the degree of cultural awareness is directly 
related to chan|e strategies a project employs. If a project is charac- 
terized as high in its cultural awareness » then its change strategies 
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¥o\xld r«fUct that awarcn«5s. The influence of role taking and ttortl 

atmosphere are critical in stimulating cultural awareness. 

Consideration of Social Justice . When social justice is invoked, the 
assumed meaning varies from a simple reciprocity of punishment or reward 
to a more purposeful distribution of resources. We assume from Rawls that 
the most ideal form of justice would provide equal opportunity and access 
to resources, and assure redistribution of the inequitably allocated resources. 

The nature of a project's intended degree of social justice would vary 
according to their intended change effort. A project that had not understood 
the latent value of inequality in the society would not attempt to equalize 
opportunity to sufficiently achieve full equity. For "ample, a project 
that attempts to equalize educational opportunities for women would fall 
short «tf an ideal goal of social justice if it were only intending to 
increa;© the number of female students in graduate school without also 
attempting to change the sex stereotyping in curriculum, administration 
and in r^ching. 

KohlbeVg suggests a continuxmi for the concept of justice which extends 
from an^aASumption of an equitable social order to an assumption of a 
deficient, unequitable social order. The variance is in one»s degree of 
cultural awareness and one's definition of justice; as one becomes more 
culturally critical and begins to see value deficiency in the social order, 
there is a growing concern for social justice. 

Change Technit^ ues. While the ideological basis of change and consider- 
ation of social justice are cognitive, change techniques are the 



Strategies and actions taken to achieve the intended change^ While we do 

not want to be dravm into a discussion of the merits of a violent or a non- 
violent strategy, ve recogniv^ thai the inpral implications whatever the choice^ are 
significant (Turner, 1970). As Tichy found, techniques that defied conven- 
tional practices were used by those attempting to alter basic inequities in 
society while those groups that practiced more conventional techniques were 
primarily interested in having an organisation run more efficiently. 

We assume that change techniques, by themselves, are not a clear 
indicator Qf a project *s ideology or potential success. When these tech*- 
niques are conslderea along with the ideological basis for change, this 
analysis enables us to further determine the extent of change expected 
trom a project. 

Stages of Development 

What we present ps ideological levels for planned social change 
projects are not discrete categories. The levels help clarify -^he relation- 
ship betweer. ideology and justice and show our proposed range cf ideological 
development . 

First level . Individuals at this level are characterised by little if 
no awareness or consideration of social justice and values. Change is justi- 
fied on an efficient or mechanistic basis, not a value One, While a project 
goal ittay be desirable, the rationale for its implementation is efficiency or 
self interest. There is no intended value change, but rather a replacement 
of one social form for a comparable one. 
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Second level . Individuals at this level are characterized by a reliance 
on the status quo as justification for change. While these individuals have 

a degree of cultural awareness, their impetus for change comes from the dominant 
culture. The change effort is a consensual, ethical redress and reflects the 
dominant cultural values. Justice, likewise, is defined by the values and 
interests of the dominant culture. 

Third level. Individuals at this level are characterized by an aware- 
ness beyond a simple acceptance of the inherent values in society. Change is 
justified by principles of social justice which would mitigate the sources 
of inequality in social institutions and its customs and attitudes. Rather 
than only treat one aspect of a value (i,e., hiring procedures), the 
interconnecting social practices and attitudes would be changed. 

Expectations of Change 

The classification of a social change project on the basis of ideological 
development can indicate the potential for change a project can induce. This 
classification, thereby, can provide an evaluation of the ultimate project 
goals, the probable extent of change to be effected, and the legacy of change 
a project will create. Although we believe a project could be effective at 
tach level of development , social change as previously defined can only be 
accoBplished at the highest level. What type of change can then be expected 
froB projects which operate at the different levels of Ideological devclopnent? 

First level . The inducement of social change at the first level of 
development is highly improbable. At this level of physical reciprocity only 
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an exchange of participants or oethods with siJnilar ideologies or techniques 

can be expected, Hven though agents of change at this level may have different 

political allegiances than the keepers of the status quo, the change agents* 

dogmatic adherence to their cause will result only in the exchange of a new 

unjust ideology for the old unjust ideology. 

In education, change that occurs at the first ideological level, such 

as mechanistic educational strategies that replace one bad method for another, 

can do little to accomplish meaningful social change. Technological innovations 

in education cannot create a more just situation when such innovations merely 

ilter the instructional message which continues to reflect the inequalities 

of sex and race. These educational techniques that reflect social inequities 

2 

become tools to assure the continuation of an unjust ideology. Any such 

educational strategy can effectively meet the desired goals, but the goals 

may do nothing to address the inequities that exist in the present educational 
systan. Such questions of social inequalities are not of concern to members 

of social change projects which operate at this first level of development. 

These problems are often deferred to other individuals or to other change 

projects in a manner similar to what Kuhn has observed in scientific research. 

Problems that do not fit a scientific paradigm are often "rejected as 

metaphysical, as the concern of another discipline," explains Kuhn (1970 : 377). 

New educational strategies can be successful, of course, as can any 

revolution. Unless the ideologies and assumptions that underlie these 

change efforts are examined, however, nothing more than an exchange of a 

new form for an old form can be expected. 
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Second level . At the second level of development change is allowable 
only within the striGtutes of the status quo* Because the preservation of the 
current social ideology is implicitly acknowledged, the only change to be 
accomplished is what the social system will allow. Individuals who 
operate at this second level of development are those who accept the cus- 
toms, norms, morals and justice of the present system* Since justice is 

♦ 

defined by the existent social ideology, individuals who operate at this 
mid-level develop strategies that will cause shifts w.ithin the social 
structure but never strategies that will cause significant social change. 
Change strategies at this level may Include efforts to modify internal 
societal processes, but when the system's structure is the "or^^in of in- 
equities, mid-level attempts can accomplish only superficial change. 

Funded interventions in this country typically occur at this second 
level. A variety of strategies to equalize social opportuiuties are developed 
from this perspective, but these efforts do not include changes to alter the 
social system* s structure. In the extreme, money is allocated merely to reduce 
the injustice, while the inherent causes are not considered. Change agents 
are often committed to the status quo at this ideological level because their 
t'fforts are funded only if acceptable changes are planned, kevolutions are 
not usually funded by the government in power. 

Change strategies in edxication at this level of developoent include, 
for example, those which only facilitate the interactions of individuals and 
groups within the present educational structure. Such efforts are devoted to 
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the detenoination of how limited ^educational rBSOxo^ces can best be distri- 
buted instead of why the educational system perpetuates such inequities. 
Change is possible, but only to a limited extent; the internal processes of 
interaction can be altered but the inherent injustices in the educational 
systeta vill remain. In a similar manner, governaent programs which patroni^ie 
the poor never address the social system's role in causing the poverty 
initially. Although change efforts at this level of development can effec- 
tively meet their goals ^ change significant enough to alter the inequities 
in the social system cannot be accomplished. 

Third level . Change agents that create strategies to question the 
morals^ customs^ values > and justice of the existent social ideology are 
those at the highest level of ideological development. By not passively 
accepting the status quo^ change agents at this level are free to search for 
new ideologies and methods to create a more just society^ Change agents 
who understand the bias of their own ideologies are able to maintain a 
cultural awareness which enables them to discard customs and morals that 
prevent the establishment of social justice* 

Because concepts of justice are dependent upon ideology, individuals 
who are critically aware of their own ideology and values operate from the 
highest level of ideological development. Change agents who assess various 
ideologies, including their own, have the potential for accom- 
plishing significant social change* Questions which consider the priority 
of values and the distinctions between wants and needs are those of concern 
for change agents at this highest level of development. Individuals at this 
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level will devise efforts to alter the causes of injustices through a critical 
analysis of the social structures that maintain inequities. In education, 
change agents vho question the basic assumptions of the educational system, 
the funding structure of schools, the role of administrators, teachers, and 
students, and the worth of educational goods and services, are better able 
to plan strategies to change the inequities that exist. 

The Case Study 

The data used in developing our framework was gathered by us as inside 
evaluators for a W-EA- funded change project which was housed at a major west 
coast university. The purpose of the project was to increase the number of 
women in public 5cho61 administration within the state. We were hired six 
months after the project began to record the project^ s activities, to develop 
evaluative measurements of the project's success and to provide feedback to 
the staff on their actions » 

One of the authors was hired to conduct an ethnographic study of the 
internal activities and process of the project while the other author was to 
develop instruments to measure the Impact of the project on the state»^ We 
expected to work as a team although our initial division of tasks delimited 
interaction. While our original concerns were limited to goals and activities 
of the project, our concerns broadened as we began to see the project in its 
larger social context. This change of focus reflected our shift from an 
emphasis on the perfomance and instrument*! goals to a concern with the 
ultimate goals t»f the project. 
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hliat follows is a description of our experiences a.s evaluators and the 
development of our theoretical perspective. Ke will also provide exair^les 
of our data analysis and the use of our framework. 

Methodology 

We achieved a synthesis in our methodologies and perspective during the 
initial months of working together, We were able to combine our interest in 
process and outcome into one broad perspective which accounted for both the 
quantifiable and empirical results and consequences of the project along with 
description of the beliefs and interactions of the people involved. In this 
initial perspective change agents and target groups were seen as engaged in an 
active and dialectical relationshii^. Because we believed that project members 

IP 

were guided by their ideologies, the process of stratcg)' formulation was seen 
as important as the outcome of that strategy* 

Emergence of Ideological Focus 

The project members* ideology became a focus as we noted changes of 
attitude and conflicts over certain beliefs. Also, as the project progressed, 
certain higher- order beliefs were used as rationale or incentive for activities. 
For exaa^Ie, when we first joined the project we noted a discrepancy in the 
members' beliefs regarding feminism. Members' responses varied from ignorance 
or a denial of being a feminist to an equally adamant statement of being a 
feminist. Within a year after this observation was made, every staff member called 
herself or himself a feminist (while there was still variance in their 
definition) . 
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Based on this observation we developed other measures to test the pre- 
sence of feminism* In addition to the field notes, a formal interview was 
conducted with each staff member regarding his/her foninist beliefs, a question* 
naire was developed and administered to each staff member, and a group dis- 
cussion was organized and facilitated by the authors. By using these multiple 
methods, we were able to check for both the presence and variety in this aspect 
of the members' ideology. 

While w« were able to clearly observe ideological changes in the members* 
concept of feminism, we wanted to see if that same developmental process 
applied to the more general concept of social justice. This concept se«aed 
appropriate to apply to a change project which had made a prior commitment 
to equity. While equity may be assumed to be synonymous with justice , the 
social structural extent to which change agents envision justice can be varied. 
We chose to focus on the use and development of the concept of social justice 
because this ideology is a more powerful determinant of change. From this 
decision, we developed a theoretical perspective that has guided our conceptual 
framework. Our data for this analysis were drawn from the following sources: 
field notes, tapes of planning and debriefing meetings, formal project docu- 
ments, and notes from informal interviews and conversations. 

Exaaples 

As an exai^le of the use of our framework, we will describe three general 
trends we observed in the project: shifts in target groins, increased respon- 
siveness to the academic community, and a continual reluctance to comit the 
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project ttfcmbcrs to more extensive social goals. These examples provide indi- 
cations of a level two group ideology. 

As an example in the shift in target groups, one activty called for the 
development of training materials on sex-role socialization and stereotyping 
for a university extension program for practicing administrators. While one 
contact was mad© and was unsuccessful due to scheduling problems, the effort 
was dropped. In another activity, a class on sex equity was developed and 
taught for undergraduates in education. While the project members did conduct 
and fund the class for a number of terms, the class did not become part of 
the regular curriculijun. 

In both of these cases, the project members assumed that instituting 
these class offerings into the regular curriculimi would help restructure the 
nature of administrative training. And in both cases direct interaction with 
the host center for purposes of adopting the courses into their cuiriculum was 
avoided. The decision not to persist in implementing changes with a primary 
target group reflects an acceptance of the status quo. 

The experiences with the class are also an exanple of the project members* 
responsiveness to the academic community in which they were housed. A major 
outcome of the class was a decision to vnrite a book on issues of sex equity 
in education which required a major commitment from the majority of the staff. 
While writing this book consumed a tremendous anount of time and energy, little 
was done to integrate the class into the regular curriculum, to negotiate 
with tenured faculty to teach it, or to incorporate any part of it into other 
course ofterlnfs. This example indicates a change in target groups fit>m prac* 
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titioners to academics and a change of strategy ftom restructuring training 
prograns to research. We interpret this as a level two ideology* In the 
face of potential conflict, the project laembers chose to abandon two activities 
that potentially would have altered the nature of administrative training. 

Lastly, an exsanple of the reluctance to conmit the project to extensive 
social goals was a staff meeting discussion about the content and emphasis of 
the project Vs self-evaluation report. When the content of one chapter was 
described by the authors in terms of "social justice/" a project member 
objected to that emphasis saying that the pj:'oject vas not funded to achieve 
that goal. The project member ^s priority was to present data to support the 
initial performance goals of the project rather than to present the results 
of the project in its ultimate social effect. This also is an example of 
level two ideology where some project staff have limited their concerns to 
the actual project activities and not to the impact of those activities* 

Implications of Our Theory Work 
Tht preceding theory- work and data examples have demonstrated how a 
project's ideology can be classified within one of three developmental 
stages to provide an evaluation of the ultimate social change a project can 
effect. The value of this conceptual framework is found in its capacity to 
assess a project *s potential for change by looking beyond the immediate 
outcomes of the performance and the instrumental goals « Knowing the ideolo- 
gical level of a project allows us to understimd the depth in which social 
change is considered by a project ^s members^ This knowledge enables us to 
predict the degree of significant social change a project is capable of 
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inducing^ Projects with different ideological levels will employ equally 
different change strategies which may have effect. Only at the highest level 
of ideological development, however, can we expect extensive changes in the 
social system. 

The importance of our theory-work is that it allows us to understand 

the extent of social change we can expect from planned social change efforts, 

such as the WEEA projects. Because the change projects funded by WBEA operate 

at the middle level of development, we cannot expect significant changes in 

the status quo. This is a realistic prediction since the WEEA projects do 

not address the limitations of the present work structure in AmeriGan society. 

Peter Drucker (1964: 130) identifies this problem and e3q)lains because Americans 

are socialized to achieve and beconc "number one," "'getting ahead' is seen 

as the exclusive criterion for success," This dissatisfaction is inherent 

in our social system because with a limited number of top positions the 

majority who want to be "number one" cannot fulfill their desire » 

This concept can be illustrated with a pyramid (see diagram 1) , In our 

American society the majority of positions with low status, power, and income 

are at the pyramid's base. The small percentage of highly sought "number 

one" positions, which are primarily accessible only to white males, are 

found at the pyramid's peak (KaHpner, forthcoming). 

Affirmative action and equal opportunity laws have attempted to remedy 
the inequities in the work structure by requiring women and minorities have 
access to all positions. Although these laws attempt to provide access to 

all vocational positions in society for women and minorities, the structure 
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of th« work system has not changed. Whereas^ prior to equal access laws 
lifomen and minoritios >fere denied access to the top positions in society 
(solid line in diagram 2)^ these individuals havenow joined vhite males 
in the race to the top of the v^ork structure (dotted line in diagram 2), 

The inherent dissatisfaction in American society^ identified by Drucker^ 
still exists even though affirmx^tive action and equal rights legislation have 
theoretically opened access to women and minorities. The original^ unjust 
Ideology has been unchanged and the social structure established for 
and by white males remains. ^♦Getting ahead^' is still the criterion for 
success and the majority will continue to be dissatisfied. With the supposed 
. vl access to positions in the work structure for women and minorities^ unless 
the niimber of top positions are increased^ even a smaller percentage of 
individuals can become ^'number one J' 

Not only do the WEEA-funded projects fail to consider the inherent 
limitations of the present educational and work structures, they also do not 
consider the problem of sex stratification in the larger society • Because 
sexism in education reflects the sex stratification in other social insti- 
tutions, projects which do not address this probledA can have only limited 
long-range success. By limiting funding for sex equity programs in education 
to WEEA> the federal government may have effectively defused the opportunity 
to effect significant social change « WEEA wy have become an effective mech* 
anism to maintain the status quo by forcing change agents to coa^ete for 
limited project money which can be used only for narrowly-defined strategies* 
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Change efforts that operate within the middle level of ideological develop- 
ment can do little but alter the internal aspects of a social system* With 
the knowledge that WEEA-funded projects operate at the middle level of 
ideological development, we can predict that change from these projects will 
not be extensive and cannot alter the aristocracy of sex. 

In suggesting that only projects at the highest level of ideological 
development will be the icost successful we do not advocate one method of 
change over another* Confrontation, awareness building, and economic incen- 
tives, for example, may be used in promoting change within any of the three 
levels we have delineated. It is the purpose behind change efforts that is 
important. If the underlying ideology involves a broad concern with social 
justice and if it includes a viewpoint that transcends the immediate situation 
we would predict that more effective change would be possible* The operation 
of social change activities at the highest level of ideological development 
provides the only manner in which the "aristocracies of colour, race and sex" 
can ever be overcome. 

Conclusions 

In this paper we have suggested that it is not sufficient to evaluate 
only the performance and instrumental goals of a project and a project^s 
Imediate outco«M8, Effective evaluation designs mist assess the ultimate 
goals, the justification for the goals, and the manner in which the goals 
were met. Because the i^st effective social change projects must operate 
at the highest level of ideological development » evaluation designs must 
include an assessment of the concepts of ideology and social justice. 
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Present decision-oriented, responsive » and value-free evaluation nethod- 
ologles can provide effective judipoents of perforhiance and instrumental goals 
for planned social change projects. Unless consideration is given to the 
projects ideology and conception of social justice, however, the real extent 
of a project's uitiiaate change efforts will not be proviced. 

Through the use of both qualitative and quantitative data, which consider 
the processes and outcomes of social change projects, effective evaluations can 
be accoiapliahed. 'Uxt importance of our conceptual framevork is not only its 
fo<, as upon ideology and social justice, hut also its emphasis on the need to 
incorporate both quantitative and qualitative data to judge more than the 
Imediate outcomes of the performance and instir»iBiental goals * Through the rich- 
ness of information qualitative data can provide in association with quantitative 
analyses, we can understand at which ideological level & project is operating 
tf enable us to predict the extent of change a project can induce and the 
legacy of change it will leave. 

Wr have used Peniin's tertn "theory-work" to describe our conceptualizations, 
.r, this theory- work we have attempted, therefore, to generate a conceptual 
traaeworif , not verify conclusions. By not assuming specific outcomes in theory* 
work the researcher is able to break out of the confines of a particular 
paradigBi to generate new concepts* Only by generating new concepts can we 
develop hypotheses and theories that offer new social perspectives. Through 
this aethod of conceptual generation we have found the consideration of the 
ideology of a project and its meobers to be essential in the evaluation of 
planned social change projects. v>ur theory-work offers a fraiiework from which 



additional research should be accomplished to refine concepts and ultimately 
lead to theory "froin which einqpirical uniformities can be derived (Merton, 

» 

1968: 143)" and verified. 

In justifying the use of our framework, we suggest that the traditional 
role of the evaluator must change. Kiaie evaluators have typically assumed 
the same social and evaluative paradigm a project prescribes, we suggest that 
an evaluator must be a critic of that paradigm and an advocate of change for 
social justice, Evaluators must stop assuming they are neutral investigators. 
If evaluators choose not to be explicit in their social values and intentions, 
we can only assume they favor maintenance of the ste.tus quo, 

Bvaluators are able to reveal, as we are attempting to do in this paper, 
the social and ideological context of change efforts, as a means to guide 
future change projects and research. We propose an advocacy role for evalua- 
tors which would allow the evaluators to use their data and insights to provide 
guidance to change efforts (Geilhufej 197S: 202). While the field of educa- 
tional research has adequate evaluative methods it is generally deficient of 
evaluators with sufficient social knowledge to jnd^e the ultimate social 
efftct of a change project. 



Reference Notes 

1. It should be noted that Kohlberg's use of the concept of role taking is 
narrower than G,H. Mead's original use of the tena (Mind, Self and Society , 
ed» Charles W, Morris, Chicago; The University of Chicago Press, 1934). 

In seeing role taVing as a part of all social inter action, Mead implies that 
all people, even those with malevolent designs, take the role of the other^ 

2. Values clarification is an example of this kind of educational change. 
While the proponents of this technique claim it is a significant innovation, 
critics view it as merely a new process which perpetuates present values. 
See Alan Lockwood, "A Critical Review of Values Clarification," unpublished 
paper. University of Wisconsin at Madison. 

3. For the complete exposition of these methodologies see: Ken Kempner, 
"A Conceptual Framework for the Evaluation of Planned Social Change," forth- 
coming PhD dissertation. University of Oregon, 1979; and Rita Pougiales, 

"A Case Study of A Social Change Project,'' forthcoaiing PhD dissertation ^ 
University of Oregon, 1973. 
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